Explainable artificial intelligence approach towards classifying educational android app reviews using deep learning

Mobile application developers rely largely on user reviews for identifying issues in mobile applications and meeting the users' expectations. User reviews are unstructured, unorganized and very informal. Identifying and classifying issues by extracting required information from reviews is difficult due to a large number of reviews. To automate the process of classifying reviews many researchers have adopted machine learning approaches. Keeping in view, the rising demand for educational applications, especially during COVID-19, this research aims to automate Android application education reviews' classification and sentiment analysis using natural language processing and machine learning techniques. A baseline corpus comprising 13,000 records has been built by collecting reviews of more than 20 educational applications. The reviews were then manually labelled with respect to sentiment and issue types mentioned in each review. User reviews are classified into eight categories and various machine learning algorithms are applied to classify users' sentiments and issues of applications. The results demonstrate that our proposed framework achieved an accuracy of 97% for sentiment identification and an accuracy of 94% in classifying the most significant issues. Moreover, the interpretability of the model is verified by using the explainable artificial intelligence technique of local interpretable model-agnostic explanations. (PsycInfo Database Record (c) 2023 APA, all rights reserved)

Exploring Social Media for Early Detection of Depression in COVID-19 Patients

The COVID-19 pandemic has caused substantial damage to global health. Even though three years have passed, the world continues to struggle with the virus. Concerns are growing about the impact of COVID-19 on the mental health of infected individuals, who are more likely to experience depression, which can have long-lasting consequences for both the affected individuals and the world. Detection and intervention at an early stage can reduce the risk of depression in COVID-19 patients. In this paper, we investigated the relationship between COVID-19 infection and depression through social media analysis. Firstly, we managed a dataset of COVID-19 patients that contains information about their social media activity both before and after infection. Secondly, We conducted an extensive analysis of this dataset to investigate the characteristic of COVID-19 patients with a higher risk of depression. Thirdly, we proposed a deep neural network for early prediction of depression risk. This model considers daily mood swings as a psychiatric signal and incorporates textual and emotional characteristics via knowledge distillation. Experimental results demonstrate that our proposed framework outperforms baselines in detecting depression risk, with an AUROC of 0.9317 and an AUPRC of 0.8116. Our model has the potential to enable public health organizations to initiate prompt intervention with high-risk patients. © 2023 ACM.

Covid-19 Vaccination Stance Detection Using Natural Language Processing and Machine-Learning Algorithms

The coronavirus outbreak has resulted in unprecedented measures, forcing authorities to make decisions related to establishing lockdowns in areas most affected by the pandemic. Social Media have supported people during this difficult time. On November 9, 2020, when the first vaccine with an efficacy rate over 90% was announced, social media reacted and people around the world began to express their feelings about this vaccination. This paper aims to analyze the dynamics of opinion on COVID-19 vaccination, in which the civil society is highly manifested in the vaccination process. We compared classical machine learning algorithms to select the best performing classifier. 4,392 tweets were collected and analyzed. The proposed approach can help governments create and evaluate appropriate communication tools to provide clear and relevant information to the general public, increasing public confidence in vaccination campaigns. © 2022 Copyright for this paper by its authors.

Fake News Detection Using Transformer and Ensemble Learning Models

On social media, misinformation can spread quickly, posing serious problems. Understanding the content and sensitive nature of fake news and misinformation is critical to prevent the damage caused by them. To this end, the characteristics of information must first be discerned. In this paper, we propose a transformer-based hybrid ensemble model to detect misinformation on the Internet. First, false and true news on Covid-19 were analyzed, and various text classification tasks were performed to understand their content. The results were utilized in the proposed hybrid ensemble learning model. Our analysis revealed promising results, establishing the capability of the proposed system to detect misinformation on social media. The final model exhibited an excellent F1 score (0.98) and accuracy (0.97). The AUC (Area Under The Curve) score was also high at 0.98, and the ROC (Receiver Operating Characteristics) curve revealed that the true-positive rate of the data was close to one in this model. Thus, the proposed hybrid model was demonstrated to be successful in recognizing false information online. © 2022 IEEE.

Analyzing COVID-Related Social Discourse on Twitter using Emotion, Sentiment, Political Bias, Stance, Veracity and Conspiracy Theories

Online misinformation has become a major concern in recent years, and it has been further emphasized during the COVID-19 pandemic. Social media platforms, such as Twitter, can be serious vectors of misinformation online. In order to better understand the spread of these fake-news, lies, deceptions, and rumours, we analyze the correlations between the following textual features in tweets: emotion, sentiment, political bias, stance, veracity and conspiracy theories. We train several transformer-based classifiers from multiple datasets to detect these textual features and identify potential correlations using conditional distributions of the labels. Our results show that the online discourse regarding some topics, such as COVID-19 regulations or conspiracy theories, is highly controversial and reflects the actual U.S. political landscape. © 2023 ACM.

Towards a smart pervasive conversational agent for COVID-19 psychological assistance based on NLP

Diverse countries throughout the world were quar-antined due to the novel pandemic known as COVID-19, even after vaccination,. As a result of this grim circumstance, most socioeconomic and political spheres have encountered deep crisis and from there people have experienced stress, anxiety, depression, and even suicide, In this paper, we propose a smart pervasive conversational agent for psychological assistance during and after COVID-19 quarantine, which could converse with a regular citizen to raise awareness of the genuine threat of the outbreak and the importance of vaccination. Our proposed conversational agent could be able to recognize and manage stress and anxiety using natural language understanding (NLU) and international stress and anxiety scales. The messages given by our agent and its mode of communication may help to alleviate anxiety following the world's lockdown. Our agent's comment threads and management styles may be able to soothe people's worry during the world's lockdown. Our proposed approach is a mobile healthcare service with three interdependent units: an input processing (IP) that performs natural language understanding (NL), a Storage that stores every interaction, and a response manager (RM) that controls the responses of our conversational agent. © 2022 IEEE.

Text Mining and Emotion Classification on Monkeypox Twitter Dataset: A Deep Learning-Natural Language Processing (NLP) Approach

Emotion classification has become a valuable tool in analyzing text and emotions people express in response to events or crises, particularly on social media and other online platforms. The recent news about monkeypox highlighted various emotions individuals felt during the outbreak. People’s opinions and concerns have been very different based on their awareness and understanding of the disease. Although there have been studies on monkeypox, emotion classification related to this virus has not been considered. As a result, this study aims to analyze the emotions individual expressed on social media posts related to the monkeypox disease. Our goal is to provide real-time information and identify critical concerns about the disease. To conduct our analysis, first, we extract and preprocess 800,000 datasets and then use NRCLexicon, a Python library, to predict and measure the emotional significance of each text. Secondly, we develop deep learning models based on Convolutional Neural Networks (CNN), Long Short-Term Memory (LSTM), Bidirectional LSTM (BiLSTM), and the combination of Convolutional Neural Networks and Long Short-Term Memory (CLSTM) for emotion classification. We use SMOTE (Synthetic Minority Oversampling Technique) and Random Undersampling techniques to address the class imbalance in our training dataset. The results of our study revealed that the CNN model achieved the highest performance with an accuracy of 96%. Overall, emotion classification on the monkeypox dataset can be a powerful tool for improving our understanding of the disease. The findings of this study will help develop effective interventions and improve public health. Author

Depression in times of a pandemic – the impact of COVID-19 on the lay discourses of e-mental health communities

The article aims at exploring the impact of the COVID-19 pandemic on the lay discourses of depression emerging in online mental health forums. The narrative framing of depression plays a central role not only because it affects the instrumental strategies of depressed people (e.g., preferred therapy), but also because it is a constitutive element of the identity of depressed people, thus affects the process of recovery itself. COVID-19 had a serious impact on people living with mental disorders (especially depression and anxiety), thus our research aimed at mapping the consequences of these transformations on a discursive level. A textual dataset of English language online health forums was collected (n = 339,550 publicly available entries posted between 15 February 2016 and 31 December 2020). Structural topic modelling was used to explore the various discursive patterns characterizing the pre-pandemic and pandemic era. Our results show that the pandemic did not take over the discursive space of depression forums, yet it transformed many aspects of it: a new horizon of critique opened up;the biomedical authority was reinforced;the ego-centric perspectives were refined;the previously unquestionable discursive frames become fragmented;and the horizon of emergency overshadowed the previous risk perspective. [ FROM AUTHOR] Copyright of Information, Communication & Society is the property of Routledge and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full . (Copyright applies to all s.)

Towards Timeline Generation with Abstract Meaning Representation

Timeline summarization (TLS) is a challenging research task that requires researchers to distill extensive and intricate temporal data into a concise and easily comprehensible representation. This paper proposes a novel approach to timeline summarization using Meaning Representations (AMRs), a graphical representation of the text where the nodes are semantic concepts and the edges denote relationships between concepts. With AMR, sentences with different wordings, but similar semantics, have similar representations. To make use of this feature for timeline summarization, a two-step sentence selection method that leverages features extracted from both AMRs and the text is proposed. First, AMRs are generated for each sentence. Sentences are then filtered out by removing those with no named-entities and keeping the ones with the highest number of named-entities. In the next step, sentences to appear in the timeline are selected based on two scores: Inverse Document Frequency (IDF) of AMR nodes combined with the score obtained by applying a keyword extraction method to the text. Our experimental results on the TLS-Covid19 test collection demonstrate the potential of the proposed approach. © 2023 ACM.

TwIdw—A Novel Method for Feature Extraction from Unstructured Texts

Featured ApplicationThe research has a potential application in the field of fake news detection. By using the feature extraction technique, TwIdw, proposed in this paper, more relevant and informative features can be extracted from the text data, which can lead to an enhancement in the accuracy of the classification models employed in these tasks.This research proposes a novel technique for fake news classification using natural language processing (NLP) methods. The proposed technique, TwIdw (Term weight–inverse document weight), is used for feature extraction and is based on TfIdf, with the term frequencies replaced by the depth of the words in documents. The effectiveness of the TwIdw technique is compared to another feature extraction method—basic TfIdf. Classification models were created using the random forest and feedforward neural networks, and within those, three different datasets were used. The feedforward neural network method with the KaiDMML dataset showed an increase in accuracy of up to 3.9%. The random forest method with TwIdw was not as successful as the neural network method and only showed an increase in accuracy with the KaiDMML dataset (1%). The feedforward neural network, on the other hand, showed an increase in accuracy with the TwIdw technique for all datasets. Precision and recall measures also confirmed good results, particularly for the neural network method. The TwIdw technique has the potential to be used in various NLP applications, including fake news classification and other NLP classification problems.

Know an Emotion by the Company It Keeps: Word Embeddings from Reddit/Coronavirus

Social media is a crucial communication tool (e.g., with 430 million monthly active users in online forums such as Reddit), being an objective of Natural Language Processing (NLP) techniques. One of them (word embeddings) is based on the quotation, "You shall know a word by the company it keeps,” highlighting the importance of context in NLP. Meanwhile, "Context is everything in Emotion Research.” Therefore, we aimed to train a model (W2V) for generating word associations (also known as embeddings) using a popular Coronavirus Reddit forum, validate them using public evidence and apply them to the discovery of context for specific emotions previously reported as related to psychological resilience. We used Pushshiftr, quanteda, broom, wordVectors, and superheat R packages. We collected all 374,421 posts submitted by 104,351 users to Reddit/Coronavirus forum between January 2020 and July 2021. W2V identified 64 terms representing the context for seven positive emotions (gratitude, compassion, love, relief, hope, calm, and admiration) and 52 terms for seven negative emotions (anger, loneliness, boredom, fear, anxiety, confusion, sadness) all from valid experienced situations. We clustered them visually, highlighting contextual similarity. Although trained on a "small” dataset, W2V can be used for context discovery to expand on concepts such as psychological resilience.

Towards Detection of Cyberbullying in Hinglish Code Mixed Data

Covid-19 eruption and lockdown situation have increased the usages of online platforms which have impacted the users. Cyberbullying is one of the negative outcomes of using social media platforms which leads to mental and physical distress. This study proposes a machine learning-based approach for the detection of cyberbullying in Hinglish text. We use the Hinglish Code-Mixed Corpus, which consists of over 6,000 tweets, for our experiments. We use various machine learning algorithms, including Logistic regression (LR), Multinomial Naive Bayes (MNB), Support vector machine (SVM), Random Forest (RF), to train our models. We evaluate the performance of the models using standard evaluation metrics such as precision, recall, and F1-score. Our experiments show that the LR with Term Frequency-Inverse Document Frequency (TFIDF) outperforms the other models, achieving 92% accuracy. Our study demonstrates that machine learning models can be effective for cyberbullying detection in Hinglish text, and the proposed approach can help identify and prevent cyberbullying on social media platforms. © 2023 Bharati Vidyapeeth, New Delhi.

CovRelex-SE: Adding Semantic Information for Relation Search via Sequence Embedding

In recent years, COVID-19 has impacted all aspects of human life. As a result, numerous publications relating to this disease have been issued. Due to the massive volume of publications, some retrieval systems have been developed to provide researchers with useful information. In these systems, lexical searching methods are widely used, which raises many issues related to acronyms, synonyms, and rare keywrds. In this paper, we present a hybrid relation retrieval system, CovRelex-SE, based on embeddings to provide high-quality search results. Our system can be accessed through the following URL: https://www.jaist.ac.jp/is/labs/nguyen-lab/systems/covrelex-se/. © 2023 Association for Computational Linguistics.

Sentiment Analysis on Twitter Data of Omicron (B.l.l.529) using Natural Language Processing

The COVID pandemic is causing outrageous interference in everyday life and financial activity. Close to two years after the presence of COVID, WHO allotted the variety B.l.l.529 a variety of concern, named 'Omicron'. Online diversion data assessment is created and transformed into a more renowned subject of investigation. In this paper, a sizably voluminous heap of appraisals and assessments are culminated with online redirection information. The evaluations and appearances of Twitter electronic diversion stage clients are summarised and researched by considering sentiment analysis by utilising various natural language processing techniques based on positive, negative, and neutral tweets. All potential outcomes are considered for investigating the feelings of Twitter clients. For the most part, tweets are assessed clearly, and this assessment ensures the headway of this investigation study. Different kinds of analyzers are utilised and measured. The 'TextBlob Sentiment Analyzer' has given the highest polarity score based on positivity, negativity, and neutrality rates in terms of inspiration, pessimism, and impartiality. A total dataset is fully determined and classified with all the analyzers, and a comparative result is also measured to find the ideal analyzer. It is intended to apply boosting machine learning methods to increase the accuracy of the proposed architecture before further implementation. © 2022 IEEE.

Need for Vision: A data-centric approach towards analysing impact of COVID-19

From the beginning of 2020, we saw a rise of a new virus called the Coronavirus and ultimately a pandemic that anyone reading this paper must have been through. With the rise of COVID,many vaccines were found, the global vaccination drive as a result of this naturally fueled a possibility of Pro-Vaxxers and Anti-Vaxxers strongly expressing their support and concerns regarding the vaccines on social media platforms and along with this came up the need of quick identification of people who are experiencing COVID-19 symptoms. So in this paper, an effort has been made to facilitate the understanding of all these complications and help the concerned authorities. With the help of data in the form of Covid-19 tweets, a (machine-learning) classifier has been built which can classify users as per their vaccine related stance and also classify users who have reported their symptoms through tweets. © FIRE 2022: Forum for Information Retrieval Evaluation.

Moral Narratives Around the Vaccination Debate on Facebook

Vaccine hesitancy is a complex issue with psychological, cultural, and even societal factors entangled in the decision-making process. The narrative around this process is captured in our everyday interactions;social media data offer a direct and spontaneous view of peoples' argumentation. Here, we analysed more than 500,000 public posts and comments from Facebook Pages dedicated to the topic of vaccination to study the role of moral values and, in particular, the understudied role of the Liberty moral foundation from the actual user-generated text. We operationalise morality by employing the Moral Foundations Theory, while our proposed framework is based on recurrent neural network classifiers with a short memory and entity linking information. Our findings show that the principal moral narratives around the vaccination debate focus on the values of Liberty, Care, and Authority. Vaccine advocates urge compliance with the authorities as prosocial behaviour to protect society. On the other hand, vaccine sceptics mainly build their narrative around the value of Liberty, advocating for the right to choose freely whether to adhere or not to the vaccination. We contribute to the automatic understanding of vaccine hesitancy drivers emerging from user-generated text, providing concrete insights into the moral framing around vaccination decision-making. Especially in emergencies such as the Covid-19 pandemic, contrary to traditional surveys, these insights can be provided contemporary to the event, helping policymakers craft communication campaigns that adequately address the concerns of the hesitant population. © 2023 ACM.

Detecting COVID-19 Vaccine Stance and Symptom Reporting from Tweets using Contextual Embeddings

Determining sentiments of the public with regard to COVID-19 vaccines is crucial for nations to efficiently carry out vaccination drives and spread awareness. Hence, it is a field requiring accurate analysis and captures the interest of many researchers. Microblogs from social media websites such as Twitter sometimes contain colloquial expressions or terminology difficult to interpret making the task a challenging one. In this paper, we propose a method for multi-label text classification for the track of”Information Retrieval from Microblogs during Disasters (IRMiDis)” presented by the”Forum of Information Retrieval Evaluation” in 2022, related to vaccine sentiment among the public and reporting of someone experiencing COVID-19 symptoms. The following methodologies have been utilised: (i) Word2Vec and (ii) BERT, which uses contextual embedding rather than the fixed embedding used by conventional natural language models. For Task 1, the overall F1 score and Accuracy are 0.503 and 0.529, respectively, placing us fourth among all the teams, while for Task 2, they are 0.740 and 0.790, placing us second among all the teams who submitted their work. Our code is openly accessible through GitHub. 1 © 2022 Copyright for this paper by its authors.

A case study of using natural language processing to extract consumer insights from tweets in American cities for public health crises.

BACKGROUND: The COVID-19 pandemic was a "wake up" call for public health agencies. Often, these agencies are ill-prepared to communicate with target audiences clearly and effectively for community-level activations and safety operations. The obstacle is a lack of data-driven approaches to obtaining insights from local community stakeholders. Thus, this study suggests a focus on listening at local levels given the abundance of geo-marked data and presents a methodological solution to extracting consumer insights from unstructured text data for health communication. METHODS: This study demonstrates how to combine human and Natural Language Processing (NLP) machine analyses to reliably extract meaningful consumer insights from tweets about COVID and the vaccine. This case study employed Latent Dirichlet Allocation (LDA) topic modeling, Bidirectional Encoder Representations from Transformers (BERT) emotion analysis, and human textual analysis and examined 180,128 tweets scraped by Twitter Application Programming Interface's (API) keyword function from January 2020 to June 2021. The samples came from four medium-sized American cities with larger populations of people of color. RESULTS: The NLP method discovered four topic trends: "COVID Vaccines," "Politics," "Mitigation Measures," and "Community/Local Issues," and emotion changes over time. The human textual analysis profiled the discussions in the selected four markets to add some depth to our understanding of the uniqueness of the different challenges experienced. CONCLUSIONS: This study ultimately demonstrates that our method used here could efficiently reduce a large amount of community feedback (e.g., tweets, social media data) by NLP and ensure contextualization and richness with human interpretation. Recommendations on communicating vaccination are offered based on the findings: (1) the strategic objective should be empowering the public; (2) the message should have local relevance; and, (3) communication needs to be timely.

A real-world evaluation of the implementation of NLP technology in abstract screening of a systematic review.

The laborious and time-consuming nature of systematic review production hinders the dissemination of up-to-date evidence synthesis. Well-performing natural language processing (NLP) tools for systematic reviews have been developed, showing promise to improve efficiency. However, the feasibility and value of these technologies have not been comprehensively demonstrated in a real-world review. We developed an NLP-assisted abstract screening tool that provides text inclusion recommendations, keyword highlights, and visual context cues. We evaluated this tool in a living systematic review on SARS-CoV-2 seroprevalence, conducting a quality improvement assessment of screening with and without the tool. We evaluated changes to abstract screening speed, screening accuracy, characteristics of included texts, and user satisfaction. The tool improved efficiency, reducing screening time per abstract by 45.9% and decreasing inter-reviewer conflict rates. The tool conserved precision of article inclusion (positive predictive value; 0.92 with tool vs. 0.88 without) and recall (sensitivity; 0.90 vs. 0.81). The summary statistics of included studies were similar with and without the tool. Users were satisfied with the tool (mean satisfaction score of 4.2/5). We evaluated an abstract screening process where one human reviewer was replaced with the tool's votes, finding that this maintained recall (0.92 one-person, one-tool vs. 0.90 two tool-assisted humans) and precision (0.91 vs. 0.92) while reducing screening time by 70%. Implementing an NLP tool in this living systematic review improved efficiency, maintained accuracy, and was well-received by researchers, demonstrating the real-world effectiveness of NLP in expediting evidence synthesis.

Examining the Public Messaging on 'Loneliness' over Social Media: An Unsupervised Machine Learning Analysis of Twitter Posts over the Past Decade.

Loneliness is an issue of public health significance. Longitudinal studies indicate that feelings of loneliness are prevalent and were exacerbated by the Coronavirus Disease 2019 (COVID-19) pandemic. With the advent of new media, more people are turning to social media platforms such as Twitter and Reddit as well as online forums, e.g., loneliness forums, to seek advice and solace regarding their health and well-being. The present study therefore aimed to investigate the public messaging on loneliness via an unsupervised machine learning analysis of posts made by organisations on Twitter. We specifically examined tweets put out by organisations (companies, agencies or common interest groups) as the public may view them as more credible information as opposed to individual opinions. A total of 68,345 unique tweets in English were posted by organisations on Twitter from 1 January 2012 to 1 September 2022. These tweets were extracted and analysed using unsupervised machine learning approaches. BERTopic, a topic modelling technique that leverages state-of-the-art natural language processing, was applied to generate interpretable topics around the public messaging of loneliness and highlight the key words in the topic descriptions. The topics and topic labels were then reviewed independently by all study investigators for thematic analysis. Four key themes were uncovered, namely, the experience of loneliness, people who experience loneliness, what exacerbates loneliness and what could alleviate loneliness. Notably, a significant proportion of the tweets centred on the impact of the COVID-19 pandemic on loneliness. While current online interactions are largely descriptive of the complex and multifaceted problem of loneliness, more targeted prosocial messaging appears to be lacking to combat the causes of loneliness brought up in public messaging.